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Abstract 

Small world models are networks consisting of many local links and 
fewer long range 'shortcuts'. In this paper, we consider some particular 
instances, and rigorously investigate the distribution of their inter-point 
network distances. Our results are framed in terms of approximations, 
whose accuracy increases with the size of the network. We also give some 
insight into how the reduction in typical inter-point distances occasioned 
by the presence of shortcuts is related to the dimension of the underlying 
space. 

1 Introduction 

In ^U] , Watts and Strogatz introduced a mathematical model for "small-world" 
networks. These networks had achieved popularity in social sciences, mod- 
elling the phenomenon of "six degrees of separation" . Further examples that 



have been suggested are the neural network of C.elegans, the power grid of 
the western United States, and the collaboration graph of film actors. The 
work of has received considerable attention during the last two years, 
in particular by physicists; see the Los Alamos server for condensed matter 
physics (http://xxx.lanl.gov/archive/cond-mat). However, a closely re- 
lated model, the "great circle model" , had already been studied by Ball et al. 
in the context of epidemics. 

The model proposed in JU| is as follows. Starting from a ring lattice (a 
1-dimcnsional finite lattice with periodic boundary conditions) with L vertices, 
the k nearest neighbors to a vertex in clockwise direction are connected to the 
vertex by an undirected edge, resulting in a 2/c-nearest neighbour graph. Next, 
each edge is rewired at random with probability p. The procedure for this 
is: a vertex is chosen, and an edge that connects it to its nearest neighbour 
in a clockwise sense. With probability p, this edge is reconnected to a vertex 
chosen uniformly at random over the entire ring, with duplicate edges forbidden; 
otherwise the edge is left in place. The process is repeated by moving clockwise 
around the ring, considering each vertex in turn until one lap is completed. 
Next, the edges that connect vertices to their second-nearest neighbours are 
considered, as before. So the rewiring process stops after k laps. The quantities 
computed from this graph are the "characteristic path length" £{p), defined as 
the number of edges in the shortest path between two vertices, averaged over 
all pairs of vertices, and the "clustering coefficient" C(j>), defined as follows. 
Suppose that a vertex v has k v neighbours. Let C v be the quotient of the 
number of edges between these k v neighbours and the possible number of edges 
( fc 2 "). Define C to be the average of C v over all v. These two quantities are 
computed for real networks in the examples above, as well as for the random 
(Bernoulli) graph with the same p. The common phenomenon observed is the 
"small- world phenomenon": that £ is not much larger than £ ra ndonn but that 

C Crandom • 

Ideally, from a probabilistic view point, one would like to determine the be- 
haviour of £(p) and C{p) so as to estimate the parameter p in the network, or so 
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as to be able to assign statistical significance levels, when distinguishing differ- 
ent network models. Physicists seem to be intrigued by the scaling properties 
of t\ see [JJ, [3, and references therein; also they enjoy studying percolation on 
this graph; see p], UJ. Percolation there is also viewed as a model for disease 
spread. 

A closer look reveals that the above model is not easy to analyze. In partic- 
ular, there is a nonzero probability of having isolated vertices, which makes £(p) 
infinite with positive probability, and hence E£(p) = oo. As a result, it was 
soon revised by not rewiring edges, but rather adding edges, thus ensuring that 
the graph stays connected; see, for example, More precisely, a number of 
shortcuts are added between randomly chosen pairs of sites with probability 
<f> per connection on the underlying lattice, of which there are Lk. Thus, on 
average, there are Lk(j) shortcuts in the graph. 

Recently, Newman, Moore and Watts [3 gave a heuristic computation 
(the NMW heuristic) of t in this modified graph. They suggest that 

E*=~/W), (1.1) 



k' 



where 



In particular, 



f(z) = — , tanh 1 



\ for z < 1 



m~\ : 2 > (i-2) 

^ forz»l. 



giving 



L_ 

ik 



for Lk(j> < 1 



i^ff^ for Lk<j> » 1. 

Their heuristic is based on mean field approximations, replacing random vari- 
ables by their expectations. 

In the context of epidemics in a spatially structured population, Ball et at 
consider individuals on a large circle in their "great circle model" . They allow 
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only nearest-neighbour (k = 1) connections, but claim that most of their results 
can be extended to general k. An SIR epidemic is studied, where each individual 
has a probability pl of infecting a neighbour, and probability pq of infecting any 
other individual on the circle; typically, pl 3> pg- I n the SIR framework, this 
model corresponds to individuals having a fixed infectious period of duration 1 . 
The structure of the graph at time T — oo is their main object of interest. In 
terms of small worlds, their model broadly corresponds to having an epidemic 
on a small- world network with parameter 4>, where 4> = pg/pl- 

In this paper, we analyze a continuous model, introduced in in which a 
random number of chords, with Poisson distribution Po(Lp/2), are uniformly 
and independently superimposed as shortcuts on a circle of circumference L. 
Distance is measured as usual along the circumference, and chords are deemed 
to be of length zero. When L is large, this model approximates the ^-neighbour 
model of if p = 2k(j>, except that distances should also be divided by k, 
because unit graph distance in the A; -neighbour model covers an arc length of k, 
rather than 1. In the case when the expected number Lp/2 of shortcuts is large, 
we prove a distributional approximation for the distance between a randomly 
chosen pair of points P and P', and give a bound on the order of the error, in 
terms of total variation distance. This distribution differs, in both location and 
spread, from that suggested by the NMW heuristic, though to the coarsest order 
0(i log(Lp)) agrees with that suggested by l|1.2|) . We also show that analogous 
results can be proved in higher dimensions by much the same method, when 
the circle is replaced by a sphere or a torus; here, the reduction in the typical 
distance between pairs of points occasioned by shortcuts is less dramatic than 
in one dimension. 
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2 The continuous circle model: construction and 
heuristics 

In this section, we consider a continuous model consisting of a circle C of cir- 
cumference L, to which are added a Poisson Po(Lp/2) number of uniform and 
independent random chords. We begin with a dynamic realization of the net- 
work, which describes, for each t > 0, the set of points R(t) C C that can be 
reached from a given point P within time t: time corresponds to arc distance, 
with chords of length zero. Such a realization is also the basis for the NMW 
heuristic. 

Pick Poisson Po(Lp) points of the circle C uniformly and independently, 
and call this set Q. The elements q € Q are called potential label 1 end points 
of chords. To each q € Q, assign a second independent uniform point of C, say 
q' = q'(q): the label 2 end point. The unordered pairs {q,q'} form the potential 
chords. Only a random subset of the potential chords are actually realized. Let 
R(t) be the union of the B(t) intervals of C, each of which increases with time, 
growing deterministically at rate 1 at each end point; we start with R(0) = {P}. 
Whenever card(dR(t—) n Q) = 1 — that is, whenever the boundary of R(t—) 
reaches a potential label 1 end of a chord (note that the intersection never 
contains more than one element, with probability 1) — so that dR{t—) n Q = 
{q}, say, accept the chord {q,q'} if q' R(t—) (that is, if the chord would 
reach beyond the cluster R(t—)) and take R(t) — R(t—) U {q 1 }; otherwise, take 
R(t) = R(t—). This defines a predictable thinning of the set of potential chords, 
to obtain the set of actual, accepted chords. The number of intervals increases 
by 1 whenever a chord is accepted, and decreases by 1 whenever two intervals 
grow into one another. 

The intensity of adding chords is 2pB(t){\ — r(t)i~ 1 }, with the label 2 
end points uniformly distributed over R c (t), where r(t) = \R{t)\, the Lebesgue 
measure of R(t). The integrated intensity is thus 
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since 4ir(t) = 2B(t) a.e. with respect to Lebesgue measure, and 

r(oo) = r(L/2) = L. 

Thus we generate Po (Lp/2) accepted chords. To see that they are uniformly 
chosen, simply note that this is true of the potential chords, and that each 
potential chord is accepted with probability 1/2, independently of the number 
and positions of all potential chords, according to whether the first of its end 
points to belong to R had initially been chosen as the label 1 or the label 2 end 
point. Thus this growth and merge construction indeed results in Po {Lp/2) 
chords, uniformly distributed over C . 

The NMW heuristic takes the equation 

j t r(t) = 2B(t), (2.1) 

and adds to it an equation 

j t B(t) = 2pB{t){l r^L- 1 } - 2B(t)(B(t) l)(L r(t))-\ (2.2) 

derived by treating the discrete variable B(t) as continuous and the correspond- 
ing jump rates as differential rates. The final term in (|2.2|) . describing the rate 
of merging, follows from the observation that the smallest interval between n 
points scattered uniformly on a circle of circumference c has an approximately 
exponential distribution with mean c/n(n — 1), and that unreached intervals 
shrink at rate 2. These equations have an explicit solution r and B, with (for 
p>0) 

1 ^ T{LW)/L = 2 { ( 0+ l) + ( -l )e ^} =: ^ (2 - 3) 
where a = \J\ + 4/Lp; this is used for 

< w < -4- log{(a + l)/(a - 1)} =: W* , 
aLp 

the range in which p(w) > 0. Then, if D is the random variable denoting the 
distance from P to a randomly chosen point, the NMW heuristic takes 

Pnmw[D >t} = l- f{t)/L 
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as an approximation to the true value P[D > t] = 1 — Er(t)/L, where r(t) 
denotes the random quantity defined in the growth and merge model. The 
formula for ~E£ resulting from this heuristic is then -jr J Q W p(w) dw with p = 2k(j), 
the factor 1/k arising from the definition of graph distance in the fc-neighbour 
model, as observed above. 

Note that the NMW heuristic always gives Pnmw[D > Lw*] = 0. However, 
since the probability of having no shortcuts is e~ Lp / 2 , it is clear that in fact 

P[D > Lw*} > e- L "' 2 {l - 2w*) > e- L d 2 — 
L J K ' 3(1 + 4/ Lp) 

so that their heuristic cannot give accurate results unless Lp is either very small 
or very big. If Lp is very small, then Pmmw[D > t] = 1 — 2t/L + O(Lp), and 
the same is true for P[D > t], reflecting that there are no shortcuts, except for 
a probability of order O(Lp). The interesting case is that in which there are 
many shortcuts, when Lp is large, and this we investigate rigorously. 

The early development of R is close to that of a birth and growth process S, 
defined as follows. We let (M(t), t > 0) be a Yule (linear Markov pure birth) 
process with per capita birth rate 2p, having M (0) = 1. To the j'th individual 
born in the process, j > 1, we associate a centre (j+i, where (Q, j > 2) are 
independent and uniformly distributed on C; we assign £i := P to the initial 
individual. Then, for any < t < L/2, we define S(t) to be the set of M(t) 
possibly overlapping intervals 

S(t) := {[Q - (t - aj),Cj + (t - <Jj% 1 < j < M(t)}, 

where aj+i denotes the birth time of the j'th individual born, j > 1, and 
o i := 0. In fact, such a process S can be constructed on the same probability 
space as R, with differences arising only when intervals intersect, in the following 
way. First, every potential chord is accepted in S, so that no thinning takes 
place, and the chords that were not accepted for R initiate independent birth 
and growth processes having the same distribution as S, starting from their 
label 2 end points. Additionally, whenever two intervals intersect, they continue 
to grow, overlapping one another; in R, the pair of end points that meet at the 
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intersection contribute no further to growth, and the number of intervals in R 
decreases by 1, whereas, in S, each end point of the pair continues to generate 
further chords according to independent Poisson processes of rate p, each of 
these then initiating further independent birth and growth processes. 

The process S thus constructed agrees closely with R until appreciable num- 
bers of intersections occur. Its advantage over R is the inbuilt branching struc- 
ture, which makes it much easier to analyze. In particular, EM(i) = e 2pt , and 
s(t) := \S(t)\ = J*2M(u)du, so that Es(t) = p- 1 (e 2 P t - 1). Furthermore, 
e~ 2pt M(t) — > W a.s., where W ~ NE(1), the negative exponential distribution 
with mean 1, and hence e~ 2pt s(t) — > p~ 1 W a.s. and — > a.s.; note also 
that is contained in the union of the intervals of S(t), and that M(t) > B(t) 
a.s. We make ample use of these facts in the coming argument. 

In order to discuss the distance between two points P and P', we modify 
this construction a little. We choose two independent starting points P and P' 
uniformly on C, and run two such constructions (R, S) and (R', S') simultane- 
ously, based on the same set of potential chords. A potential chord {q, q'} such 
that dR(t-) n Q = {q} is only accepted for R if q £ R{t-) U R'(t-), and it 
initiates an independent birth and growth process in 5* if not accepted for R; 
the corresponding rule holds if dR'(t—) n Q = {q}. If two intervals in R U R' 
merge, the pair of end points which meet contribute nothing further to R or R', 
but each continues to contribute independently to S or S', as appropriate. This 
construction is actually the same as the previous, but starting with M(0) = 2; 
further, a record is kept of which of the two initial individuals was the ancestor 
of each subsequent interval. If, by time t, no pair of intervals, one in R and the 
other in R', have merged, then d(P, P') > 2t; otherwise, d(P, P') < 2t. 

Our strategy is to approximate the event of an R-R' merging of intervals 
having occurred by looking for S(t)-S'(t) intersections. Every pair of R-R' 
intervals merged up to time t is contained in a pair of S(t)-S'(t) overlapping 
intervals. However, there may be other S(t)-S'(t) overlapping pairs, either 
(Type I) because one or other of the pair arose as progeny in a birth and 
growth process which was not part of R or R' — following the non-acceptance 
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of a chord in R or R', or the merging of two intervals — or (Type II) because 
one of the pair is itself an interval [q' — (t — a), q' + (t — a)] coming from a chord 
{q,q'} which was not accepted at time a, and the other is an interval which 
contained q' at time a. Type II pairs can be recognized at time t, because one 
of the intervals is entirely contained in the other. 

So, taking Lp large, consider the situation at time t x = {i log(Lp) + x}, 
with x > — ilog(Lp) to make t x > 0. Letting R x = R(t x ),S x — S(t x ),M x = 
M{t x ), and s x = s{t x ), we have EM X = {Lp) 1 / 2 e x and Vs x = p- 1 ({Lp) 1 / 2 e x - l) 
Thus there are about Lpe 2x pairs of intervals with one in S x and the other in S' x , 
and each is of typical length p -1 , so that the expected number of intersecting 
pairs of intervals is about j^Lpe 2x — 2e 2x , which is small when x is large and 
negative, and becomes large as x increases to become large and positive. We 
show that the number of Type I pairs is of rather smaller order, so that their 
influence is unimportant. However, the expected number of Type II pairs is 

2 f X 2pe 2pu L- 1 Es(u) du - e 2x , 
Jo 

or about half the total number of intersecting S(t)-S'(t) pairs, and these have 
to be taken into account. Labelling the intervals in S x as I\, . . . ,Im x and the 
intervals in S' x as Ji , . . . , Jn x , where the indices are assigned in chronological 
order of birth, we set 

Xij = im n Jj + 0} l{I t t Jj} l{Jj t Ii], (2.4) 

and write 

M x N x 

»=i i=i 

We show that the event V x = is with high probability the same as the event 
V x = 0, where V x is the number of R x -R' x merged pairs of intervals. Finally, if 
there are no R X ~R' X merged pairs, the "small worlds" distance between P and 
P' is more than 2t x . For later use, let pi(l) denote the unique index j < I of the 
interval Ij to which is linked by a chord — the 'parent' of I\ — and define pj 
analogously. 
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3 The continuous circle model: proofs 

The first step in the argument outlined above is to establish a Poisson approxi- 
mation theorem for the number of pairs of S x —S' x overlapping intervals, exclud- 
ing Type I and Type II pairs. The approximation is based on the following 
general result. 

Theorem 3.1 Let Xi, . . . ,X m andY\, . . . , Y n be independent random elements, 
and let <pij := <fiij(Xi,Yj) be indicator random variables with pij := E0,y such 
that 

max{maxE(0«0ife),maxE(^i,-^y)} < ppij, 

k^j l=it 

for all pairs i,j, where p > maxijpij. Then, if $ :— X)"=i Sj=i fej 

dry(£($), Po (E$)) < (2(m + n) - 3)p. 

Proof: Using the local version of the Stein-Chen method (0, Theorem l.A), 
we have 

m n 

d Ty (£($),Po(E<f)) < (E*)- 1 ^^^. + Pij EZ ij +E(cl> ij Z ij )), 

i=l j=l 

where 

m n 
i=i i=i 

By assumption, E((f>ijZij) < (m + n — 2)ppij, and the result follows. j 

This theorem, in the context of intervals scattered on the circle, has the 
following direct consequence. 

Corollary 3.2 Let m intervals Ii, . . . , I m with lengths si, . . . ,s m and n inter- 
vals J\,...,J n with lengths Ui, . . . , u n be positioned uniformly and independently 
on C. Set V := Y^T=i Sj=i X v> where 

Xij := n J -j £ 0] t Jj] I[Jj <t Ii]. 

Then 

dTv(£(V),Po (A( )) < i(m + n)l sn /L, 
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where 

m n 

\ m ,n,s,u) ■= 2L _1 ^ ^2 min { s i; u j}> S '■= i S U ■ ■ ■ , «»), 
i=l j=l 

u := (ui, . . . , u n ) and l su := max{maxsi, maxitj}. 

* j 

Proof: We apply Theorem 13 . II with Xi and Yj the centres of the intervals li 
and Jj, and with Xij for 0^; the Xij are pairwise independent, and satisfy 
EXij < 2l su L~ 1 . It remains only to note that 

m n 

EV = 2L~ X ^2 ^2 minjsj, uj} = A (min>SiU ). [] 
i=i j=i 

The corollary translates immediately into a useful statement about V x . We 
define s x and u x to be the sets of lengths of the intervals of S x and S' x , and we 
always take x > — \ \og{Lp), so that t x > 0. 

Corollary 3.3 For the processes S and S' of the previous section, we have 

\P[V X = 1 M x = m,N x = n,s x = s, u x = u] - exp{-A( TO) „ iSiU )}| 
< 8(m + n)r x L~ x . 

Proof: It suffices to note that all the intervals of S x and S' x are of length at 
most 2t x , and hence that the chance of a given pair intersecting is at most 
AL~ x t x . [] 

Remark. If P and P' are not chosen at random, but are fixed points of C, 
the result of Corollary 13.31 remains essentially unchanged, provided that they 
are more than an arc distance of 2t x apart. The only difference is that then 
Xn = a.s., and that Ar mi „ iSiU ) is replaced by A( m „ iSiU ) — 4t x /L. If P and P' 
are less than 2t x apart, then P[V X = 0] = 0. 

The next step is to show that P[V X = 0] is close to P[V X = 0]. We do this by 
directly comparing the random variables V x and V x in the joint construction. 

Lemma 3.4 With notation as above, we have 

P[V X £ V x ] < At x L~ 2 V{{M x u x + N x s x )(M x +N X - 1)(1 + log M x + logN x )}. 
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Proof: Let the intervals of S x and S' x and their lengths be denoted as for 
Corollary 13.21 with m and n replaced by M x and N x , and write s x :— s i 
and u x := Y^f=i u j as before; set S x :— {J^ h, S'J :— U;^j Jl- Define 

H a := {Jin Si ^0}; tf i2 := |J ({/; n ^ 0} n (*) = J}) 

i<;<i 

H i3 ■■= IJ ({/*nS^0}n{^(i) = Z}), 

i<;<i 

where A l (i) £ {1,2, ... ,1} denotes the largest of these indices to be an ancestor 
of i, and set Hi :— \J V=1 H iv ; define H' iv , 1 < v < 3 and H[ analogously. Note 
that, for I < i, the event {A (i) = 1} is the event that I is an ancestor of i. Then, 
with Xij defined as in l]2.4[l . 

v x > v x > e E i[fl-; c ], (3.i) 
i=i j=i 

so that 

Ma, ^ 

o < % - < E E x ^ t 1 - 7 ^ c ] 7 W), 

and hence 

P[V X + V x ] < E(V X - V x ) (3.2) 

!M X N x 3 
E E ^ E( 7 ^» = !] + 7 ^ = !]) • 
<=i j=i «=i j 

Now, conditional on M x , N Xl s x and u x , the indicator is (pairwise) indepen- 
dent of each of the events H iv and H'j v , 1 < v < 3, because ifji, and ifj 3 
are each independent of (j, the centre of Jj, and H'^, Hj 2 and £/i3 are each 
independent of Q. Moreover, the event {A L (i) = 1} is independent of M, TV 
and all Q's and £j's, and has probability 1/2, since the Z Yule processes, one 
generated from each interval /„, 1 < v < I, which combine to make up S from 
time ai onwards, are independent and identically distributed. Hence, observing 
also that no interval at time t x can have length greater than 2t x , it follows that 

EiXyllHn] | M x , N x ,s x ,u x } < L^{ Sl + Uj )(M x - 1)(At x /L); 
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E{X tf J[JT j2 ] I M x , N x ,s x ,u x } < r 1 £ _1 («< + u,)4t x (M x - 1)/L 

1=1 

< AL- 2 T X (M X - 1) logM^Sj + Uj), 

and 

i-l 

E{X l3 I[H l3 }\ M X ,N X , s x ,u x } <J2 rl L' 1 {s l +u j )^T x N x /L 

1=1 

< AL- 2 t x N x log M x ( Si +Uj). 

Adding over i and j thus gives 

M x N x 

i=1 j=l 

< AL- 2 t x E{[{M x - 1)(1 + logM x ) + logMaKMrti, + A* Sx )} , 
and combining this with the contribution from E{XijI[H^]} completes the proof. 



To apply Corollary and Lemma l3~4l it remains to establish more detailed 
information about the distributions of M x and s x . In particular, we need to 
bound the first and second moments of M x , and to approximate the quantity 
Eexp{-A (Mx ,jv xiSx , Ux) }, where 

i=i j=i 

= 4L _1 / / min(r x - v, t x - w)dM(v)dN(w) 
Jo Jo 

= [ M(v)N(v)dv. (3.3) 

Jo 

As from now, we assume that Lp > 16. We begin with the following lemma. 
Lemma 3.5 For any x > — h\og(Lp), we have 

P[M x >r] = (l-q x ) r -\ r>l, 
where q x — e~ 2pTx . Hence, in particular, 

EM, = e 2pT * = e x ^/Tp, ±E{M X (M X + 1)} = e 2x Lp (3.4) 
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and 

\V{M X (M X + 1)(M X + 2)} = (f^fTp)* , 
and, ifx<\ \og(Lp), 

E{logM4 < |log(Lp); (3.5) 

E{M X logM x } < l\og{L P )e x ^Tp, (3.6) 



and 



furthermore, 



E{M X (M X + 1) logMJ < | log(Lp) e 2x Lp; (3.7) 



Es x M x < 2p~ i e 2x Lp. (3.8) 

Proof: Let z t — z t (w) :— E(w M ^^). Then, by splitting at the first jump, 
which is exponentially distributed with mean 1/2/3, we have 

z t = we~ 2pt + f 2pe~ 2pu z 2 _ u du. (3.9) 



Multiplying by e 2pt and differentiating, it follows that 

dz 

— = -2zp(l-z); z = w. (3.10) 
Solving the differential equation now gives 

E (w M W) = we- 2 ? 1 (1 - w(l - e- 2 ? 1 ))- 1 , (3.11) 

so that 

P[M(t) =m] = e- 2pt (l-e- 2pt ) m ^ , m > 1. (3.12) 



The moments in (|3.4ll are immediate, and (|3.5|l - (|3.7|) follow because logm < 
2pt + mer 2pt , so that, for instance, 

E{M x logMJ < 2 P t x EM x + VM 2 e- 2pT * 
< (|log(Lp) + 2)e 2 ^, 
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and log(Lp) > 2 in Lp > 16. Finally, 

E{s(t)M(t)} = 2 [ ~E{M(u)M(t)}du 
Jo 

= 2 f e 2p ^E{M 2 (u)}du 
Jo 

= 2p- 1 e 4 P t {l-e- 2 P t (l + pt)}, 

and the lemma is proved. 

We shall also need some information about the conditional distribution 
of M(s) given :— a{M(u), u > t}, for s < t. This is summarized in 
the next lemma. 

Lemma 3.6 For any < s < t, 

£(M(s) | T? n {M(t) = m}) = 1 + Bi (m - 1, >- 

In particular, setting W(u) := e~ 2pu M(u), it follows that 

/ -2ps _ „-2pt\ 

E(W(s) W(t) | F?) = ^ i e _ 2pt j (1 - W(t)) (3.13) 

and 

E{(W(s)-W(t)) 2 \^n 

/ p -2ps _ p -2pt\ 

= ( ' (1 _ e - 2pt)2 j {( e " 2pS - ^ 2P4 )(! - ^W) 2 + (W(t) - e~ 2pt )(l - e- 2 " s )}. 
Fwrt/iermore, 

E{s x logM x } < |p- 1 log(L P )(l + e a; ) v ^ (3.14) 

and 

E{s x M x logM x } < y- 1 log(Lp)e x (l + e x )Lp. (3.15) 

Proof: From the branching property of M, and with z u as in the previous 
lemma, it follows that 

E{v M ^w M ^} = E{v M ^(z t - s (w)) M ^} = z s (vzts(w)) 



1 - io(l - e - 2 ' , (*- s )) - uwe-^'-^fl - e- 2 ''- 5 ) ' 
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Hence, from the coefficient of w m , and since M is a Markov process, the prob- 
ability generating function of £(M(s) | n {M(t) — m}) is 

(1 - e -2 ^* -8 )) + ue -2 ^* -8 ) (1 - e~ 2ps ) " ' 



1 - e- 2 P* 

proving the first statement of the lemma. The W^-moments are now immediate. 
For the last part, note that 

V(s x \M X ) = 2 [' E(Af (u) | M x ) du 
Jo 

2 I \e 2p{u - T ^ M x {\ ~ e- 2 ^)- 1 + du 



o 



< p- l M x + 2t x , 

again using the first part of the lemma, and the remaining conclusions follow 
from Lemma 13.51 ! 

The estimates of Lemmas l3.5l and l3.6l can already be applied to Corollarv l3.3l 
and Lemma 13.41 

Corollary 3.7 For any x > — h log(Lp), we have 

\P[V X = 0] - Eexp{-A (Jtf . iJV . iB . iU .j}| 

< 6e x (Lp)-^ 2 log(Lp) + 60e 2x (l + e x ){Lp)- x l 2 log 2 (Lp). 

We now estimate the quantity Eexp{— \m x ,N x ,s x ,u x )}- Since e~ 2pt M{t) is 
a martingale, and converges a.s. to a limit W, and since e 2pTx — e x \[Lp, it is 
clear from (|3.3|) that 

exp{-A (J ^ iJViE ,s„u*)} ~ exp ^-AL^WW' J * e ipv dv^ ~ exp{-e 2x WW'}, 

where W is an independent copy of W, so that P[V X = 0] can be approximated 
in terms of the distribution of the limiting random variable W associated with 
the Yule process M. Here, we make the precise calculations. 

Lemma 3.8 We have 

-y 



= o 



{e x (l + e 2x )(Lp)-i} 
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uniformly in — * log(ip) < x < \ log(Lp), where c x = e 2x . 

Remark. Recall that W = lim^oo e~ 2pt M{t) and W = lim t ^oo e- 2pt N (t) . 
Note that, as W and W' are independent and exponentially distributed with 
mean 1, we have 

POO — u . . 

/ T~r dy = E ( e - ww ' e2x \ , (3.16) 

Proof: We begin by observing that, for a, b > 0, 

|e- a -e- fo - (b-a)e- b \ < \{b - a) 2 . 

Hence it follows that 

E^expj-^^ M(u)N(u)du\ -expj-^J^ We 2pu N(u) du\ 

+ T,J ~ We2pU ^ N ^ du ex P {"^ j£ We 2pv N(v) dv^ 

~ 1 B {~lJ (M(U) ~ We2pU ) N ( u ) du } > ( 3 - 17 ) 
and also that 

E^exp|-i^ iy e 2pu 7V(M) duj -expj— ^jf WW'e 4pu du^ 

+ lj We2pU i N< y u )~ W ' e2pU ) due ^\^J j J o WW'e 4pv dv^ 
~ ^ E {l/ We 2pu (N(u) -W'e 2pu )du^ . (3.18) 

Now, examining the second line of (|3.17() . we first condition on W, which 
is equivalent to conditioning on Wit) for very large t, and apply (|3.13() from 
Lemma 13.61 to give 



|e Qf (M(«) - We 2pu )N{u) du cxp (~ J We 2pv N(v) dv^ 
I (1 - WO-ZV(u) exp J We 2pv N(v) dvV\ ; 
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hence it follows that 



E (J X (M(u) - We 2pu )N{u) duexpi—JJ We 2pv N(v) dv 

< e||1-W|-^^ X N(u)du \ < j^e 2pT * =2e x {Lp)- 1 / 2 . 
For the last line of l|3.17[l . we have 

E{(M(u) - We 2pu )(M(v) - We 2pv )} = e 2p ( u+v ^{(W (u) - W){W{v) - W)}. 
Writing 

e -2ps _ e -2pt 

c ( s '*) := l_ e -2pt » 
and again using Lemma 13. 61 it thus follows for < u < v that 

E{{W(u) - W)(W(v) - W)} 

= c{u, v)E{(l - W{v)){W{v) - W)} + E{(W(v) - W) 2 } 
= (1 - c(u, v))E{{W(v) - W) 2 } + c(u, u)E{(l - W)(W(v) - W)} 
= e- 2pv (l - c(u, v)) {EW(1 - e- 2 "") + e-^E^l - T^) 2 }} 
+ c( M , V )e- 2pt, E{(l- VK) 2 }, 

so that < E{(W(u) - W){W{v) - W)} < K e - 2pv for some K > 0. Hence 

E {z/ X ( M ( U )~ We 2p ")^(M)du| 

= Jl I I e 2p(u+v) V{{W{u) - W)(W{v) - W)}F,{N(u)N(v)} dudv 



JO 



^ T2 I I Ke 2pu V{N{u)N{v)}dudv, 
L Jo Jo 

and, for < u < v, 

F,{N(u)N(v)} = e 2p{v - u ^N 2 {u) < 2e 2p{u+v \ 
from l|3.4|l : this gives 

Ely / * {M{u)-We 2pu )N{u)du\ < (8K/3)e 3x (Lp)-^ 2 



for the last line in l|3.17|l . A similar argument for the components of l|3.18[l 
completes the proof. [] 
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Theorem 3.9 If P and P' are randomly chosen on C , or if P and P' are fixed 
points of C at arc distance more than j- \og(Lp) from one another, then 







p 


[ D >i( 




p \ 



log(Lp) + x 



e v dy 



1 + c x y 



O 



(e*{l + e 2 *)(Lp)-Hog 2 {Lp)) 



uniformly in — ^ log(Lp) < x < ^log(Lp), where, as before, D denotes the 
shortest distance between P and P' on the shortcut graph. 



Proof: Since 



{V x = 0} 

the theorem follows from Corollary 13 . 71 and Lemma f3. 81 



D > - p Q log(ip) + x 



Corollary 3.10 If T denotes a random variable with distribution given by 

e~ v dy 



P [T > x] = I 
Jo 

and D* = ± (| log(Lp) + T), then 



o 1 + e2x V 



sup|P[£> < x] -P[D* <x}\ = ({L P y hog 2 (Lp)) . 

x V / 



PROOF: As c — > oo, we have 



oo „ — 



e v dy ( i \ 1 , 1 1 , 

< 1-e " +-logcH logc. 



I 1 + cy V / c cc 

So use the bound from Theorem 13.91 for x < log(Lp), and the tail estimates 
of C{D*) outside this range. 

Note that the asymptotics of the NMW heuristic give 



NMW 



D> - p {\ 1 °s( l p) + x 



1 + e 



1 (1 + OdLp}- 1 / 2 )), 



2x 



agreeing with Theorem l3.9l onlv at the \og(Lp) order. Under the NMW heuristic, 
the asymptotic distribution of pD — \ log(Lp) is a logistic distribution with mean 
zero, whereas the true asymptotic distribution given in Corollary I3.1UI has mean 
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Figure 1: The asymptotic distribution function of pD — i log(Lp) (solid line) 
and that predicted by the NMW heuristic (dotted line) 

ET = ^7 m 0.2886, where 7 is Euler's constant, and has a much wider spread: 
see Figure HI 

As in the NMW model, we could instead have taken the number of shortcuts 
to be fixed at \Lp. Using a standard deviation argument, such a process could 
with high probability be bracketed by two processes with Poisson numbers of 
shortcuts, but with different shortcut rates 

pi = p{\ - KL~ 1 yf~Lp\og(Lp)} and P2 = p{l + kL^ 1 y^Lp\og(Lp)}, 

for k big enough. Expanding log(Lpi) and log(Lp2) around log(Lp), we see that 
the distributional approximation for the shortest path length would remain the 
same, for a slightly different region and with different error bounds. 
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4 r dimensions 



Our method of proof can be adapted to many other models. Here, we consider 
only the generalization of the previous continuous circle model to higher dimen- 
sions, taking Po (Lp/2) shortcuts between random pairs of points in a finite, 
homogeneous space C in r dimensions, such as a sphere or a torus, where L is 
the area of C. We construct the shortcuts by a "growth and merge" process 
as before, but now with intervals replaced by local neighbourhoods of the form 
C + tK after growth time t, where £ is the centre and K 3 is a given convex 
set in r dimensions. The basic Poisson approximation of Theorem 13 . II can be 
applied as before; we then need to find an appropriate r x , and to make the 
necessary computations for the associated pure growth process. In particular, 
we shall need to be able to approximate the sums 

m n 

i=i j=i 

where p(si,Uj) is the probability that two independently and randomly dis- 
tributed sets, one an SiK and the other a UjK, intersect one another. We 
assume this probability to be of the form 

r 

p(si,Uj) = L -1 y ] QjSjtt^ - ' for constants a; = a r _;. (4-2) 

i=o 

In one dimension, as in the previous section, ag = ot\ = 2; for a torus in 
two dimensions with K a unit square [— 1, l] 2 , ao = a±/2 = c*2 = 4. For 
a sphere in two dimensions, it is almost the case, neglecting curvature, that 
ao = a%/2 = «2 = 7r, and the error in using this approximation is negligible for 
large L, to our order of approximation. As in 1-dimcnsion, we shall also have 
to discount intersections of neighbourhoods where one is entirely contained in 
the other. 

For the pure growth process with independently and uniformly positioned 
neighbourhoods, define its neighbourhood size process by the purely atomic 
measure (£ t , t> 0) on R + : 

= ^{neighbourhoods with radii having lengths in A}. 
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Then the quantities 

M,(t) := / x L Z t (dx), I > 0, 



are basic to our analysis: Mo(t) is just the number of neighbourhoods in the 
pure growth process at time t, corresponding to M(t) in the circle model, and 

Af (t) 

i=i 

is the sum of the Z'th powers of the 'radii' of the neighbourhoods. In particular, 
in view of jUJ and l|4.2l) . the analogue of A( m Tl s u ) of Corollary 13.21 is easily 
expressible for two pure growth processes M and N at time t as 

L- 1 S^aiM^Nr^iit) - v(K) {N r {u)dM (u) + M r (u)dN Q (u))^ , (4.3) 

where v(K ) is the volume of K. 

The quantities Mi(t), < I < r, satisfy the following evolution equations: 

^-M i (t)=iM. l _ 1 {t), i>2; 
dt 

j t Mi{t) = M (t) for a.e. t; (4.4) 

M (t) - prv(K) [ M r _i(u)dtt = X (t), 
Jo 

where Xo is a martingale, with -Xo(0) = 1 and with (centred) Poisson inno- 
vations having rate prv{K)M r -\{t) at time t. Properties of their solution are 
given in the following theorem. 

Theorem 4.1 Let M(t) denote the (r + l)-vector (M (t), M r (t)) T . Then, 
as t —>■ oo, 

EM(i) ~ r -1 e Ao *e (0) ; EM 2 (f) = 0(e 2A °*), 

wZiere 

Ao = A (p) := (rM*Q)*5 e<°> = (1, A Q -\ 2A ~ 2 , . . . , (r - l)!^^, rlX^f. 
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Furthermore, 



wher 



W(t) := M(t)e 



W:=-<1 

r 



-Ant 



e {0) W a.s., 



- x ™dX (y) 



satisfies P[W > 0] = 1, and 

(jiy'XinWjit) - Wef\ < c r (l + (X t) 1/2 l {r=6} ) e -^ x -^\ < j < r, 
/or some constant c r not depending on p, where 

oj* = max{0, cos(27r/r)}. 
Remark. The fact that Wo{t) — > a.s. implies that 



M (t)- 1 e t {[0,6)} = 1 - W (t - b)e- Xob /W Q (t) 1 

for all 6 > 0, so that the form of e( ) is not surprising. 
PROOF: Solving l|4.4|) for the vector M(t), we find that 

M(t) = Ae A * / e- A yX (y)e°dy + X (t)e°, 
Jo 

where e° is the coordinate vector (1, 0, 0, ... , 0) T , and 

( c \ 

1 



-An 6 



A := 



2 • 



(4.5) 



y r y 

has eigenvalues A r = and Ao, . . . , A r _i satisfying the equation A r = (r — l)!c: 
here, c = prv(K). Thus Ao = {c(r — 1)!}^ is real and positive, and A; = Xqlui, 
where u>t = e 27 ™'/ r are the complex r'th roots of unity. 
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The eigenvectors of A are also easy to determine. The r'th eigenvector 
e( r ) is the coordinate vector e r = (0, . . . , 0, 1) T , and all others have components 
eo, ■ • ■ , e r satisfying the equations 

ce,._i = Ae ; e — Xa; 2e\ = Ae 2 ; 
(r — l)e, — 2 = Ae r _i; re r _i = Ae r , 

for A = Ao, . . . , A r _i. These in turn give 

ei = A _1 e ; e 2 = 2A _2 e ; 
e r _i = (r — l)!A _ ( r_1 )eo = Ac _1 eo; e r = r!A~ r eo. 

Thus it follows that, for < / < r - 1, 

T 



(l,(Ao^)- 1 ,2(A ^)" 2 ,---,(^-l)!(Ao^)~ ( ^ 1) ,c- 1 r) . (4.6) 



The eigendecomposition can now be used to determine M(i) more explicitly. 
Writing e° in terms of the e^, < Z < r, we find that 

r 

e° = Hie^ with /io = • • • = Mr-i = r ~ X an( i /V = —r/c. 

1=0 

Using this to evaluate 14. 5f) . we obtain 

M(t) = [\(X (y)-l) + l}y2e ( - l ^ l X l e x '^dy + X (t)s°. (4.7) 
Turning to the moments of M, we immediately have 



EM(t) = / ^e^ViAie^^-^dy + e 
J ° 1=0 

r — 1 

= Y I ( e Aotoi _ 1) e (0 + £ „ i e A t e 



To estimate second moments, observe that, given .Ft, cLYo(i) is a centred Poisson 
innovation, so that 

E (d 2 X (t)) = cE(M r -i(t))dt ~ cr -1 e Aot e^ 1 dt = r^Aoe* ' dt. (4.8) 
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But now, in 14. 7f) . we can write 

AfM(t) := / (X (y) - l)A,e A '(*-»)dy = [ {e x ^ - l}dX (v), 
Jo Jo 

since Xo is a.s. of bounded variation on finite intervals. Hence, from 1)4.8(1 . 

E|MW)(t)| 2 < 2r- 1 A / e Aol, {f + e 2 ^'^-^} dv. (4.9) 
j o 

For 1 < Z < r — 1 , we can bound the integral in (|4.9|l . uniformly in I and p, 
in terms of oj* and Xo(p)t. If 1 < r < 4, so that = 0, it is immediate that 
ElAfW^i)! 2 < 4r- 1 e Ao *. Ifr = 5, so that < < 1/2, the bound has an extra 
factor of 1/(1 - 2a;*); if r = 6, then = 1/2, and E\M (1 ^(t)\ 2 < ir' 1 X te Xot ; 
for r > 7, E\M^' l \t)\ 2 < 4r- 1 (2cj* - i)-^ "**. In all cases, for all 1 < I < 
r - 1, we have E|M (u) (i)| 2 = o(e 2A °*), and since also 

E\MW(t)\ 3 < r- x Ao f e 2Xot ~ Xov dv < r" 1 ^*, 
./o 

it therefore follows easily that 

EM 2 (t) = 0(e 2Aot ) asi^oo, (4.10) 

with the constant implied in the order estimate uniform for all p. 

The convergence of W(t) can now be proved by second moment arguments. 
It follows directly from (|4.8fl that Var Xo(t) = r~ 1 (e Xat — 1), and thus, using 
Kolmogorov's inequality on the martingale X 0l we can easily show that, for any 
S > 0, 

sup \X (t) - i| e -(*o+*)t/a < ^ (4 n) 

t>0 

Now, from (f^TTf) . 

W(i) = e - Aot M(t) 

= e - Aot EM(i) + e- Ao *(X (t) - l)e° 

+ Ajfo^-lJ^eW/ilAie^^dye-^*, (4.12) 
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and we consider the various terms in 14.12fl . using (|4.11|) . First, it is immediate 
that 

lim e- Xat (X Q (t) - 1) = a.s. 

t — >-oo 

Then, distinguishing the cases &(A;) < 0, < 5R(A ; ) < A /2 and A /2 < 5R(A/) < 
Ao, it again follows from (|4.11() that, for 1 < / < r — 1, 

r 

t — *oo 



lim / {X o (y)-l)ni\ l e X ' it ~ y) ~ Xot dy = 0a.s. 
Finally, for I = 0, we have 

poo 

lim / (X (y) - l)\ e~ XoV dy = a.s. 
Hence, letting t — > oo in 1)4. 12|) . it follows that the limit 

limW(t) = e (0) i(l+ / Xo(X Q (y) - l) e - Xoy dy\ = We {0) 



r 



exists a.s. To show that ~P\W > 0] = 1, note that 

where (C/j, I > 1) are the times of the births of new neighbourhoods as children of 
the original neighbourhood around P, and (W''\ I > 1) are independent copies 
of W. This immediately implies that P[W = 0] G {0, 1}, and P[W = 0] = 1 is 
excluded by EW = 1/r. 

Note also that, again because Xq is locally of bounded variation, 



W(oo)- W(i) 



r-1 



^oeWe-^* - 5>«/i ; e- Aot (e A,t - l) 



O p -\ot , .. _(0) 



-£ e 







W e(°' e - W - £ e<' V _Aot (e Ait - l) 
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-£ e 

r-l 



Thus 

(jO-^lECW^foo) - W,-(t))| < Crl e- A »( 1 -^)« (4.13) 
and, from l|4.8|l . 

Var{(j1)- 1 A J (^M-^(t))}< Cr2 e- 2A «( 1 -"*)*{l + (Aoi)l { , =6 }}, (4.14) 
for some constants c r \ and c r 2 and for all < j < r, completing the proof. [] 

Now choose 

r ilog(L P ) + xl, (4.15) 



Ao(p) 12 

for any a; such that \x\ < jlog(Lp), much as in the case r = 1. Let as 

before be the number of pairs of overlapping neighbourhoods, one from each of 

two independent pure growth processes M(t x ) and N(r x ) and neither contained 
entirely in the other. Then, from (|4.3|) and Theorem 13. II it follows easily that 

P[V X = 0] - Ecxp j-ZT 1 rp^MiiT^Nr^Tv) 

-v(K) ( (N r (u)dM (u) + M r (u)dN (u)) 
Jo J 

= 0((Lp)- 1 / 2 \og r (Lp)e*), (4.16) 

since the probability of a given pair of neighbourhoods overlapping cannot ex- 
ceed 

L- 1 Kv{K)rl = 0{{Lp)- l \og r {Lp)), 

for some constant k depending on the shape of K, and because EMo(t x ) ~ 
r~ 1 (Lp) 1 / 2 e x from Theorem 14.11 Then, with a proof much as for Lemma [3.41 
bounding Mq above by a Yule process with rate pv{K)rr^~ x and noting that 
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we now only have P[A l (i) = I] < l/l, because in higher dimensions more recent 
neighbourhoods grow more slowly, it follows that 



P[V X + V x ] = OiiLp)- 1 ' 2 log 2r (Lp)e 3x ), 



(4.17) 



where V x is the number of times that pairs of neighbourhoods of the two associ- 
ated growth and merge processes R and R' meet before t x . These observations 
lead to the following theorem. 

Theorem 4.2 Let D denote the distance between two randomly chosen points 
of C on the graph with a Po (Lp/ 2) -distributed random number of shortcuts. 
Then 



2 f 1 
D > ^—r^r i, - log(ip) + x 



Hp) 12 

= E [ exp J -e 2x WW 



+0 {{Lp)-^ 1 -^/ 2 log 2r+1 (Lp)(e 3x + e*)} , 

uniformly in \x\ < j\og(Lp), where W and W are independent copies of the 
limiting random variable of Theorem \4-l\ 

PROOF: In view of (|4.1(il) and l|4.17|l . it is enough to show that 

Eexp J -L~ l (^2aiMi(T x )N r -i(T x ) - v(K) f ' (N r (u)dM (u) + M r (u)dN (u)) 



si=0 



E I exp ^ -e 2x WW 



1 r 



+ O(X t x exp{2x - A (l - w*)t x }). 



However, direct calculation shows that 

(T x ) 



1=0 



v ' 1=0 



£a*{A^*)}{AS-^(r x )} 



and that 

L~ 1 v(K) [ (N r (u)dM Q (u) + M r (u)dN (u)) 
Jo 

= L~ l v{K) L 2XoT *{W (t x )W;(t x ) + W^{T x )W r {r x ) 
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~ r J q * e aAott {W (u)W;_ 1 (u) + W^(u)W r -i(u)} du^ 
= e 2x (W (t x ){ P v(K)W;(t x )} + W^T x ){pv{K)W r {T x )}) 

- ^ f" A e 2Ao " {W Q (u){\^rpv(K)WU{n)} 

+ W '(u){\ 1 rpv(K)W r - 1 (u)}) du 

where, by Theorem 14. II 

m^KW^t) -W\< c r (l + (Aot) 1 / 2 l {r=6} )e- A ^ 1 --)*, < j < r, 

in which, for j = 0, r — 1 and r, the left hand side takes the form E| Wo(t) — W\, 
ElX^rpv^Wr^t) - W\ and E\pv(K)W r (t) - W\ respectively. Then the 
inequality \e~ a — e~ b \ < \a — b\ for all a, b > completes the proof. 

Note that in the r-dimensional model, the distances D have Xo(p) in the 
denominator, of order 0(p 1 ^ r ), in place of 2p in the case r — 1. This scaling 
can be understood as follows. If there were no shortcuts, the average distance 
between pairs of points would be of order L 1 ^. With about Lp/2 shortcuts, 
this distance is reduced by a factor of order (Lp)^ 1 / 1 " log(Lp). Thus, in a higher 
dimensional space, the reduction in distance as a result of introducing shortcuts 
is correspondingly smaller. 
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